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MULTIPLE MODE POWER THROTTLE MECHANISM 

Related Patent Applications 

This patent application is related to U.S. Patent Application No. , "Digital 

Throttle for Multiple Operating Points", filed on even date herewith and assigned to the same 
assignee. 

Background of the Invention 

Technical Field The present invention relates to microprocessors and, in particular, to 
mechanisms for controlling power consumption in microprocessors. 

Background Art . Modern processors include extensive execution resources to support 
concurrent processing of multiple instructions. A processor typically includes one or more 
integer, floating point, branch, and memory execution units to implement integer, floating point, 
branch, and load/store instructions, respectively. Register files and on-chip caches are also 
provided to supply the execution resources with operands. When fully engaged by an executing 
program, these resources can create significant power dissipation problems. 

Instruction code sequences that include enough instructions of the correct type to fully 
engage a processor's execution resources for significant intervals are relatively rare. Smart 
compilers and out of order execution can only extract so much instruction level parallelism (LLP) 
from most code. To conserve power, a processor may employ a clock gating mechanism to cut 
off the clock signal delivered to execution resources or their components that are not used by an 
executing code sequence. Such a processor can engage extensive resources as needed, e.g., to 
support code sequences with high LLP, without dissipating large amounts of power when code 
sequences with more typical ILP levels execute. 
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For code sequences having high ILP, few if any resources can be gated off, and the 
processor can dissipate significantly greater power than it does running code characterized by 
more typical ILP. To accommodate power-hungry code, a processor may be run at less than its 
top performance level by, for example, limiting its operating frequency. Hobbling the processor 
in this manner leaves a thermal margin for those code sequences that cause the processor to 
dissipate large amounts of power. 

An alternative strategy, called power throttling, allows the processor to operate at its top 
performance level by default and reduces (throttles) the performance level if the processor's 
power consumption becomes too great. Power throttling may be implemented through a number 
of mechanisms. These include altering the number of instructions processed per clock cycle 
(instruction throughput) or altering the voltage and/or the frequency at which the processor 
operates (operating point). These and other power control mechanisms have their particular 
advantages and disadvantages. 

Power dissipation scales quadratically with processor voltage, making adjustment to 
voltage levels a potent tool for controlling processor power. Power dissipation scales linearly 
with the processor's clock frequency. However, frequency and voltage are typically adjusted 
together, because the maximum frequency is limited by the voltage drive available at transistor 
gates. Further, the latency for operating point adjustments is significantly greater than the time 
scale on which a processor's power consumption can change, making it a relatively course 
mechanism for managing these changes. Power dissipation scales linearly with instruction 
throughput. Adjustments to instruction throughput may be implemented with lower latency than 
operating point changes, but they may not be sufficient to offset a change in power consumption. 
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The present invention addresses these and other problems associated with monitoring and 
controlling power consumption by processor and other programmable devices. 

Brief Description of the Drawings 

The present invention may be understood with reference to the following drawings, in 
which like elements are indicated by like numbers. These drawings are provided to illustrate 
selected embodiments of the present invention and are not intended to limit the scope of the 
invention. 

Fig. 1 is a block diagram of one embodiment of a computer system on which the present 
invention may be implemented. 

Fig. 2 is a block diagram of one embodiment of a processor that implements a digital 
power throttle in accordance with the present invention. 

Fig. 3 is a block diagram of one embodiment of a digital power throttle implemented by 
the processor of Fig. 2. 

Fig. 4A is a block diagram of one embodiment of the monitor circuit of the digital power 
throttle of Fig. 3. 

Fig. 4B is a block diagram of an alternative embodiment of the monitor circuit of Fig. 

4A. 

Fig. 5 is block diagram of one embodiment of the mode unit of the digital throttle shown 
in Fig. 3. 

Fig. 6 is a flowchart representing one embodiment of a method for engaging different 
power control mechanisms in accordance with the present invention. 
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Fig. 7 is a block diagram of another embodiment of a monitor circuit for the digital 
throttle shown in Fig. 3. 

Fig. 8 is a flowchart representing another embodiment of a method for engaging different 
power control mechanisms in accordance with the present invention. 

Detailed Description of the Invention 

The following discussion sets forth numerous specific details to provide a thorough 
understanding of the invention. However, those of ordinary skill in the art, having the benefit of 
this disclosure, will appreciate that the invention may be practiced without these specific details. 
In addition, various well-known methods, procedures, components, and circuits have not been 
described in detail in order to focus attention on the features of the present invention. 

The present invention provides a mechanism for controlling the power dissipation of a 
processor using multiple power control modes. A computer system includes a processor having 
a digital throttle. The digital throttle monitors the activity of the processor to estimate the 
processor's power state. The digital throttle triggers one of the multiple power control modes, if 
warranted by the estimated power state. For one embodiment of the invention, a first power 
mode is triggered, if the estimated power state reaches a first threshold. A second power control 
mode may be triggered, depending on the response of the processor to the first power control 
mode. 

The various power control modes may be engaged according to the latencies with which 
they control power dissipation. For example, instruction throughput control mechanisms, such 
as no-operation injection and single instruction issue, effectively adjust the number of 
instructions processed per clock cycle. These mechanisms may be implemented within several 
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clock cycles of detecting a power state problem. They can be used to make small adjustments to 
power state, and their relatively short latency allows them to address problems associated with 
rapid current changes, e.g. voltage droop associated with large di/dt. 

Frequency control mechanisms, e.g. reducing clock frequency if power dissipation 
exceeds a threshold, may have greater impact on power dissipation. Frequency control takes 
more time to implement than throughput control, since the phase locked loops that drive clocks 
need to be readjusted. Combined voltage and frequency mechanisms have still greater impact on 
power dissipation, but have the longest implementation latencies. The present invention allows 
one or more power control mechanisms to be engaged, depending on the power state of the 
processor. 

Fig. 1 is a block diagram of one embodiment of a computer system 100 in which the 
present invention may be implemented. Computer system 100 includes one or more processors 
110, a main memory 140, a non- volatile memory 150, various peripheral devices 160, and 
system logic 170. System logic 170 controls data transfers among processor(s) 110, main 
memory 140, non- volatile memory 150, and peripheral devices 160. A power delivery unit 180 
is also shown. Computer system 100 is provided to illustrate various features of the present 
invention. The particular configuration shown is not necessary to implement the present 
invention. 

Processor 110 includes multiple units 124, which form an instruction execution pipeline 
120. Instructions are provided to processor 110 from main memory 140 and non-volatile 
memory 150. A digital throttle 130 monitors power consumption in the various units 124 in 
response to the processed instructions and adjusts operation of processor 110 accordingly. 
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As an instruction is staged down pipeline 120, it directs various units 124 to perform one 
or more operations that, taken together, implement the instruction. For example, a floating-point 
multiply-accumulate instruction (FMAC) may cause the following operations to occur in the 
indicated resources: a floating point register file reads out three operands; an FMAC execution 
5 unit multiplies two of the operands and adds the product to the third operation; an exception unit 
checks the product and sum for errors; and a retirement unit writes the result to the floating point 
register file if no errors are detected. Depending on the particular processor implementation, 
these resources or their components may be grouped into one or more units which are turned on 

5 and off as the instruction is staged down the pipeline. Each unit consumes a certain amount of 

I© current as it is activated by the instruction. 

H For one embodiment of the present invention, the current or power consumed by a unit 

124 is represented by an associated weight or weights. When a unit is activated by an 
instruction, digital throttle 130 detects its active state and includes a first weight in a sum 

5 representing the activity, e.g. current or power consumption, of the processor on a given clock 

15 cycle. If the unit is not activated, digital throttle 130 may add a second weight to the sum. The 
second weight may be zero or a value representing current or power consumption of the unit in 
the inactive state. For one embodiment, the resulting weighted sum is scaled to reflect the 
processor's current operating point. For another embodiment, the individual weights may 
themselves be scaled. Digital throttle 130 implements these operations over a selected interval, 

20 generates a value representing an estimated power state for the processor, and adjusts the 
processor's operation if the value exceeds a specified threshold level. 

Fig. 2 represents in greater detail one embodiment of processor 110. For the disclosed 
embodiment of processor 110, pipeline 120 is represented as fetch (FET), expand (EXP), register 
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(REG), execution (EXE), detect (DET), and retirement (RET) stages, respectively, and the 
execution resources corresponding to each stage are indicated. The present invention does not 
require partition of processor 1 10 into a particular set of pipeline stages. For example, a 
disclosed stage may be subdivided into two or more stages to address timing issues or facilitate 
5 higher processor clock speeds. Alternatively, two or more stages may be combined into a single 
stage. Other embodiments may include hardware for processing instructions out-of-order. The 
disclosed pipeline provides only one example of how operations may be partitioned in a 
processor implementing the present invention. 
N The front end of pipeline 120 includes fetch unit 210 and issue unit 220, which provide 

IS instructions to execution units in the back end of pipeline 120 for execution. Fetch unit 210 
M retrieves instructions from memory 140 directly or through a local cache (not shown) and 
s provides the fetched instructions to issue unit 220. Issue unit 220 decodes the instructions and 
jj issues them to the execution resources in the back end of pipeline 120. 
S Throughout this discussion, the term "instruction" is used generally to refer to 

15 instructions, macro-instructions, instruction bundles or any of a number of other mechanisms 

used to encode processor operations. For example, the decode operation may transform a macro- 
instruction into one or more micro-operations (^iops), resolve an instruction bundle into one or 
more instruction syllables, or retrieve a micro-code sequence associated with an instruction. 
The back end of pipeline 120 includes register unit 230, execution unit 250, exception 
20 unit 260 and retirement unit 270. Register unit 230 includes a register rename unit and various 
register files (not shown) to identify the registers specified in the instructions and to accesses the 
data from the identified registers, respectively. Execution unit 250 includes one or more branch 
execution units (BRU) 252, integer execution units (IEU) 254, load/store units (LSU) 256, and 
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floating point execution units (FPU) 258 to process branch, integer, load/store, and floating point 
instructions. Exception unit 260 checks the results generated by execution units 250 and adjusts 
the control flow if an exceptional condition is encountered. If no exceptional conditions are 
detected, retirement unit 270 updates the architectural state of processor 1 10 with the results. 

The units activated by different instructions correspond to various combinations and 
subsets of the execution resources indicated for pipeline 120. For example, one unit may include 
a floating-point register (in register unit 230), and FPU 258 may have components in two or 
more units. In general, a unit includes various execution resources (register files, execution 
units, tracking logic) that are activated and deactivated together. The present invention does not 
depend on the detailed mapping between the units and the execution resources shown in Fig. 2. 

Fig. 3 is a block diagram representing one embodiment of digital throttle 130 and its 
interactions with units 124 of pipeline 120. The disclosed embodiment of digital throttle 130 
includes gate units 310(l)-310(n) (generically, gate unit 130), a monitor circuit 320, a throttle 
unit 360 and a mode unit 390. Each gate unit 310 is associated with a unit 124 in pipeline 120 
and is capable of indicating an activity state of its associated unit. For example, gate unit 310 
may be a clock gating circuit that couples or decouples a clock signal to unit 124 according to 
whether or not the services of unit 124 are necessary to implement an instruction currently in the 
pipe stage in which the unit operates. 

For the disclosed embodiment of digital throttle 130, each gate unit 310 provides a signal 
to monitor circuit 320 to indicate an activity state of it associated unit. If the signal is asserted, 
monitor circuit 320 adds a first weight to an estimate representing the per clock activity of 
processor 1 10. The first weight represents the current or power drawn by unit 124 when it is 
activated. If the signal is not asserted, monitor circuit 320 adds a second weight to the estimate. 
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The second weight represents the current or power drawn by unit 124 when it is deactivated. 
The second weight may be zero or a value representing a leakage current in deactivated unit 124. 
A typical processor may include 10-20 gate units 310 to control power delivery to 10-20 units 
124. 

Monitor circuit 320 collects signals from gate units 130, assesses a current power state 
from the collected signals, and determines whether to invoke one of the power control 
mechanisms, based on the assessed power state. If power control is warranted, monitor circuit 
320 signals throttle unit 360 to implement one of the power control mechanisms. Mode unit 390 
monitors the effects of the implemented power control mechanism and determines whether to 
invoke a different power control mechanism. Mode unit 390 may receive an indication of the 
efficacy of the current power control mechanism through monitor circuit 320, throttle unit 360 or 
some other source. 

For the disclosed embodiment of digital throttle 130, monitor circuit 320 includes an 
activity monitor (AM) 330 and a threshold unit (TU) 350. AM 330 tracks the processor's 
activity, based on the activity states of monitored units 124, and provides an indication of the 
activity to TU 350 for comparison with a threshold value. TU 350 determines if the indicated 
activity has reached the threshold value and signals throttle unit 360 to trigger a power control 
mode if the threshold is reached. 

For one embodiment of digital throttle 130, the threshold value indicates a high power 
consumption state, and throttle unit 360 triggers the processor to initiate a first power control 
mode. The first power control mode may, for example, provide linear control of power reduction 
by reducing instruction throughput or reducing the operating frequency of the processor. Mode 
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unit 3, monitors the effect of the first power control mode and, if warranted, activates a second 
power mode. 

Fig. 4A is a block diagram of one embodiment of monitor circuit 320. The disclosed 
embodiment of AM 330 includes weight units 432(1) - 432(n) (genetically, weight units 432), an 

5 adder 434, a storage unit (SU) 444, and an accumulator 446, Each weight unit 432 is associated 
with one of units 124 through a corresponding gate unit 310. Weight unit 432 provides a first 
weight to adder 434 if the activity state signal from its gate unit 310 is asserted, and a second 
weight if the activity state signal is not asserted. A value in SU 444 may represent, for example, 

H a nominal power or current level. The threshold value is negated and provided to another input 

4B of adder 434. 

Q Adder 434 determines a difference between the threshold value and the sum of the 

ljy weights indicated by weight units 134. This difference represents an activity level, relative to 
S"; the, e.g., nominal power level (relative activity level or RAL). It is added to a value in 
m accumulator 446, which maintains a running tally of the relative activity level. For one 
M embodiment of AM 330, the relative activity level is provided on each clock cycle to 

accumulator 446, which effectively integrates the per cycle activity relative to the threshold 
value. For example, the weights may be scaled to represent an estimate of the per cycle power 
consumption of units 124, and the first threshold value may be a specified average power. In this 
case, the value in accumulator 446 represents thermal excess or deficit, relative to a temperature 
20 associated with the average power state. 

Other embodiments of AM 330 may include circuitry to forward the value in accumulator 
446 to threshold unit 350 at a specified sampling frequency. The sampling period allows digital 
throttle 130 to moderate the impact of power consumption spikes. 
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For the disclosed embodiment of monitor circuit 320, the value tracked by accumulator 
446 (e.g. accumulated power or current consumption) is provided to TU 350 for comparison with 
a threshold value. The disclosed embodiment of TU 350 includes a storage 454 and a 
comparator 458. As noted above, the value in accumulator 446 may be provided on each clock 
cycle or following a specified sampling period. Storage 454 stores a value representing a 
threshold level against which the value in accumulator 446 is compared. For the example 
described above, the threshold may represent upper and lower temperature thresholds that trigger 
power reducing and power increasing mechanisms, respectively, if reached. 

If the accumulated current consumption reaches the threshold represented by storage 454, 
TU 350 provides a signal to throttle unit 360, which triggers a power-control mechanism. As 
noted above, this may be accomplished by issuing fewer (more) instructions per clock cycle, 
reducing (increasing) the clock frequency at which the processor operates, reducing (increasing) 
the voltage at which it operates, or some combination of these strategies or other power reduction 
(increasing) strategies. 

The power consumed by the processor's units depends the operating point of the 
processor. For example, at lower frequencies and/or voltages, a given unit consumes less power 
in its activated state. Accordingly, one embodiment of AM 330 includes a scaling unit to adjust 
its activity estimation to reflect changes in the operating state. For other embodiments of digital 
throttle 130, AM 330 may also include a scaling unit to adjust its computations to reflect changes 
in the processors operating state. If a power control modes adjust the operating point of 
processor 110 to address an out-of-range power state, the scaling units allow AM 330 to adjust 
its estimate of processor activity to reflect the new operating point. 
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Fig. 4B shows another embodiment of monitor circuit 320 modified to account for 
changes in the operating point on the monitored activity of processor 110. The disclosed 
embodiment of AM 330 includes a first scale unit 436 at the output of adder 434. A conversion 
unit (CU) 340 includes a second adder 442, SU 444, and an optional second scale unit 448 at the 

5 output of SU 444. 

Adder 434 sums the weights indicated by weight units 134 and scale unit 436 adjusts the 
sum to reflect the current operating point of the processor. A signal OP1 indicates the current 
operating point to scale unit 426. For example, scale unit 436 may store scale factors appropriate 

Q for different operating points and apply the scale factor appropriate for the current operating 

.ft) point, responsive to OP1. 

2 The scaled activity level is then combined with the level from SU 444 through adder 442. 
~~ Scaling unit (SU) 448, if present, allows a similar scaling to be applied to the value in storage 

ftj unit 444, responsive to a change in the processor's operating point, indicated by OP2. As noted 

f| ; 

03 above, power control may be accomplished by issuing fewer (more) instructions per clock cycle, 
T5 reducing (increasing) the clock frequency at which the processor operates, reducing (increasing) 

the voltage at which it operates, or some combination of these strategies or other power reduction 
(increasing) strategies. To the extent any of these changes effect the weighting appropriate for 
monitored units 124 or threshold value in TSU 444, new scale factor(s) may be selected for use 
by digital throttle 130. 

20 Fig. 5 is a block diagram of one embodiment of mode unit 380, suitable for switching 

among different power control mechanisms. The disclosed embodiment of mode unit 380 
includes a saturation unit 510 and a mode selector 550. Saturation unit (SU) 510 monitors the 
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efficacy of a power control mode that is currently operative, and mode selector 550 selects 
which, if any, power control mode is operative, based on inputs from TU 250 and SU 510. 

The disclosed embodiment of SU 510 includes and an adder 514, a reset unit 518, an 
accumulator 520, and comparators 530(a), 530(b) and threshold stores 534(a), 534(b). Adder 
5 514 and reset unit 518 monitor the output of TU 350 to determine whether or not the first power 
control mode is engaged. Accumulator 520 increments or decrements a stored value, according 
to whether or not the first power control mode is engaged. The stored value indicates how often 
the first power control mechanism is being engaged. If this value reaches a first threshold, e.g. 

£ s 

Q the value in store 534(a), the first control mode is being activated too frequently, and a second 
M control mode is warranted. If this value reaches a second threshold, e.g. the value in store 
H 534(b), the second control mode is no longer necessary. First and second comparators 530(a) 
~. and 530(b) assert their signals to mode selector 550, which adjusts the control modes 
hy accordingly. 

ffl For one embodiment of the digital throttle the first control mode adjusts instruction 

B throughput (ITP) and the second control mode adjusts the processor's operating point (OP). One 

mechanism for adjusting instruction throughput is to inject no-operations (NOPs) into the 

execution pipeline of the processor. U.S. Patent Application No. " " describes on 

mechanism for injecting NOPs. 

For a multi-mode digital throttle that employs instruction throughput rates and operating 
20 points to control power consumption, mode selector 550 may implement the actions summarized 

in Table 1. Here, AL refers to the (scaled) activity level tracked by AM 330 and TC refers to the 

throttle count tracked by mode unit 380. 
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Table 1 



Power Threshold 


Upper Saturation 
Threshold 


Lower Saturation 
Threshold 


Current Mode 
Status 


Action 


AL < PT 


TC<UST 


TC>LST 


Nominal OP 
Nominal ITP 


None 


AL>PT 


TC<UST 


TC>LST 


Nominal OP 
Nominal ITP 


Reduce ITP 
(activate 1 st mode) 


AL<PT 


TC<UST 


TC>LST 


Nominal OP 
Reduced ITP 


Raise ITP 
(deactivate 1 st mode) 


X 


TC>UST 


TC > LST 


Nominal OP 


Reduce OP 
(activate 2 nd mode) 


X 


TC>UST 


TC<LST 


Reduced OP 


Raise OP 
(deactivate 2 nd mode) 



Fig. 6 is a flowchart representing one embodiment of a method 600 in accordance with 
the present invention for controlling power consumption in a processor. Method 600 monitors 
610 the activity of the processor, based on active/inactive states of its component units. The 
estimated activity may be scaled according to the current operating point of the processor to 
provide an indication of the processor's power state. The activity level is compared 620 against 
an allowed range of activity levels. If the comparison 620 indicates the processor is operating 
outside the range, instruction throughput is throttled 630 and a throttle count is adjusted 640. 

The throttle count is checked 650 to determine whether instruction throttling is being 
effective. For example, if instruction throttling is invoked repeatedly and the activity level 
remains outside the specified range, it is not effectively controlling the processor's power state, 
and the operating point of the processor is reduced 660. If weight scaling is supported, the 
weights used to scale the monitored activity level are also adjusted 670 and monitoring 610 
continues. 

If the processor activity level is within the specified range 620, the operating point of the 
processor is checked 670. If the operating point had been decreased previously, a timer is 
checked 680. The timer enforces a base interval between operating point switches to avoid 



P 12491 



15 



switching the operating point too frequently. If the interval has passed 680, the operating point is 
increased 690 and weights used to determine the activity level are adjusted 670 and monitoring 
continues. If the interval has not passed 680, no operating point adjustment is made on this pass. 
Method 600 has been illustrated for the case in which the first control mechanism is 
5 instruction throttling and the second control mechanism adjusts the processor's operating point, 
e.g. its voltage and/or frequency. Persons skilled in the art of processor design, having the 
benefit of this disclosure will recognize that other power control mechanisms may be employed. 
Further, the different mechanisms may each have different levels of operation. For example, the 
2 processor's operating point may be adjustable to a number of different frequency/voltage 
jp combinations, depending on the processor's power state. Similarly, instructions may be throttled 
u; for longer or shorter periods, depending on how long the relative activity level stays above the 
s threshold. For example, a no-operation (NOP) may be introduced into the instruction stream for 
OJ every n* actual instruction, with n taking on a range of values. 

2 Fig. 7 is a block diagram of another embodiment of digital throttle 130. The disclosed 

T5 embodiment of digital throttle incorporates multiple CUs 340(l)..340(n) (generically, CU 340) 
and associated TUs 350(1). . .350(n) (generically, TU 350). Each CU/TU pair may be used to 
monitor the processor power state for different power/timing regimes. For example, a second 
CU/TU pair 340(1)/350(1) may compare a different relative activity level (RAL) to a threshold 
indicating that frequency (or voltage/frequency)-based power control mechanism is warranted 
20 (OP1 threshold). 

A mode control unit 380 is also shown to monitor the power control mechanisms and 
switch between power control modes based on the behavior, e.g. saturation, of the active power 
control mode(s). For example, if ITP power control mode is engaged repeatedly (saturates), 
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mode control unit 380 may engage a frequency-based power control mode. With frequency 
control mode engaged, mode control unit 380 may engage a voltage or voltage/frequency-based 
control mode in response to continued, repeated engagement of ITP. 

Fig. 8 is a flow chart representing yet another embodiment of a method 800 for activating 

5 different power control mechanisms. Method 800 tests relative activity levels (RAL1, RAL2) 
820 against their respective thresholds, and engages, e.g. ITP or frequency-based power control 
mechanisms as indicated. ITP is checked 834, 846 in both modes for signs of saturation. In ITP 
mode, frequency adjustment may be engaged if saturation is detected 834. If frequency mode is 

Q engaged, voltage or voltage/frequency mode may be engaged if saturation is detected. 

if Adjustments to the processor's operating point (frequency and/or voltage) may be accompanied 

2 by corresponding adjustments to the weights employed to monitor the processor's activity levels. 
If no RAL threshold is crossed 820, method 800 may increase 856 the operating point of the 

fy processor if it had been previously reduced via 840, 860. 

ffl The resulting combination of power control modes and levels within different power 

5 i 

fB control modes allows the processor's power state to be fine-tuned in a manner that reduces the 
impact of power throttling on processor performance. 

There has thus been provided a digital throttle that monitors the activity of a processor 
and selects one of two or more power control mechanisms as required to address power state 
problems. The disclosed embodiments have been provided to illustrate various features of the 
20 present invention. Persons skilled in the art of processor design, having the benefit of this 
disclosure, will recognize variations and modifications of the disclosed embodiments, which 
none the less fall within the spirit and scope of the appended claims. 
We claim: 
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